pferrel's Stuff

Home » pferrel (1 trail)
pferrel's Stats (public trails only):
Trails created: 105
Marks created: 303
Views received: 47,234
Positive ratings: 1
Negative ratings:
Comments received: 17
Comments left: 70
pferrel

The only good marmot is a dead marmot.

pferrel's Trails: distributed + processing    (view all)

Uses

MapReduce is useful in a wide range of applications, including: "distributed grep, distributed sort, web link-graph reversal, term-vector per host, web access log stats, inverted index construction, document clustering, machine learning, statistical machine translation..." Most significantly, when MapReduce was finished, it was used to completely regenerate Google's index of the Internet, and replaced the old ad hoc programs that updated the index and ran the various analyses. [2]

MapReduce's stable inputs and outputs are usually stored in a distributed file system, such as Google File System. The transient data is usually stored on local disk and fetched remotely by the reduces.

[edit]

Tags: mapreduce, hadoop, hadooppresentations, présentationtemplate, uneprésentationtemplate, ...
A trail of 5 pages